Appn. 



Number 10/092.965 (Brittain et al) GAU2655 Ararat. A contd. 8 of 37 



REMARKS 

Applicants have amended the above application to place it in clear condition for 
allow? mce. Specifically the independent claims have been strengthened to more precisely 
reflect the technology described in Applicants' Sound Annotation System. For example, 
the fo lowing concept has been added to the independent claims: When a marker of sound 
or gly Dh is reached during the playback of a sound stream, the user can select whether 
they v rant to listen to the sound annotation or not Previously this concept was included 
in a d« pendent claim. 

The Rejection of Claims 1-4, etc. On Daberko, Matthews, 
and Balasubramanian Under §103 Is Overcome 

These claims were rejected as unobvious over Daberko et al (Daberko), Matthews, and 
Balasi ibramanian et al (Bala). While applicants believe that their Sound Annotation 
System as claimed was novel and unobvious over these patents* these claims have been 
replac ed with new claims 32 to 59 to define Applicants' Sound Annotation System even 
furthe r over the references. 

App licants 9 Sound Annotation System 

Appli : ants' Sound Annotation System improves communication and collaboration. It 
work? with recorded streams of sound. Once a stream of sound has been captured, 
airaot itions of sound concerning the stream of sound can be added at positions of interest 
or relwance. A marker of sound or glyph is logically or physically inserted in the stream 
of soi tnd to identify the location of the annotation of sound. The marker of sound or 
glyph points to or links with the annotation of sound, which adds additional information 
conce rning the stream of sound at the point of interest or relevance. The annotation is 
also captured and can convey any information desired, for example, to add description, 
provi le evidence, challenge validity, ask questions, etc. Any form or frequency of sound 
can b : utilized with the stream of sound, the marker of sound or glyph, and or the 
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annot£ tions of sound. Applicants' Sound Annotation System also consists of and has the 
following advantages: 

Selectable Use, When a marker of sound or glyph is reached during playback, 
the system is paused and users have the opportunity to select whether they want to 
listen to the associated annotation of sound or not Tliis allows users to listen only 
to the annotations of sound that are interesting, relevant, or appropriate to them. 
This greatly improves the likelihood that the communication or collaboration will 
take place. Users only have to listen to the information that is appropriate, 
relevant, or interesting to them. 

Security Protection. The system can create, select, and playback classified and 
unclassified information. This means that the streams of sound and annotations of 
sound can include all information that is interesting and important to the 
company, group, or individual users involved with the communication and 
collaboration. 

Distribution and Access. The system can distribute and provide access to the 
streams of sound and annotations of sound to users involved with the 
communication and collaboration. This means that die streams of sound and the 
annotations of sound are available to only those users who are authorized to have 
access to them. 

Sound Annotation Nesting. As previously described, annotations of sound are 
linked at appropriate or relevant places within a stream of sound. Because these 
annotations of soitfid are also streams of sound, additional annotations of sound 
also can be inserted in them at appropriate or relevant places. This allows for 
sound annotation nesting, a hierarchy of streams of sound and annotations of 
sound to be created and played back. This forms a very flexible structure of 
streams of sound and sound annotations and further enhances communication and 
collaboration because the user only has to listen to the information thai is 
interesting, relevant, or appropriate to them. 

Full Sound Spectrum. The system can include all sound, whether it is above, 
within, or below the threshold of sound that is heard by the human ear. If the 
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sound is outside the range of human hearing, the system can detect an important, 
relevant, or appropriate sound and can generate annotations of sound for 
communication with humans. This means that streams of sound and annotations 
of sound can include all sound, below, within, and above the range of human 
hearing. 

• Navigational Capabilities. Because the system provides the identification of 
markers of sound or glyphs during playback, the user has the option of listening to 
the stream of sound or skipping to the next marker of sound or glyph. The system 
also provides for the capability of skipping to the end of the annotation of sound if 
the user decides she no longer wishes to listen to the annotation of sound. These 
navigating capabilities further allow users to listen only to the information thai is 
interesting, relevant, or appropriate to them. 

• System -Tailoring. The system can be tailored by system administrators and 
users as appropriate through the use of administrator-defined and user-defined 
operational parameters. This allows administrators and users to define how the 
system is used to enhance communication and collaboration for their specific 
situation and needs. 

• Unidirectional and Bidirectional Communication and Collaboration. The 

system provides support for unidirectional and bidirectional communication and 
collaboration. Unidirectional implies that one person or group is providing 
information to users. The creating person or group does not want or solicit 
feedback, questions, or replies using the system. Bidirectional implies that both 
the creating person or group, and the users are involved in the communication or 
collaboration. Users have the capability to create annotations of sound that are 
linked to the stream of sound. If allowed by the operational parameters of the 
system, any user has the capability to create and distribute or grant access to an 
original stream of sound. This means that the system offers considerable 
flexibility, efficiency, and capability to enhance communication and 
collaboration. 
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Dabei k ko et al (Daberko) 

Daber co provides a method for inserting a new message within a previously recorded 
message. At a point in the previously recorded message the first pointer is created. The 
first p winter points to the new message that is to be inserted into the previously recorded 
message. The new message is physically placed at the end of the previously recorded 
message. At the end of the new message a second pointer is created that points back to a 
position just after the first pointer that was placed in the previously recorded message. 
By fo lowing the pointers during playback the previously recorded message along with 
the new message is seamlessly heard by the user. 

Dabei ko describes but one method of inserting messages within other messages. There 
are ot ler methods for inserting messages within messages: for example, 1) the insertion 
of the new message can be accomplished by timing from the start of the original message 
to a p ?int when the new message is to begin, and 2) the original message along with any 
new r lessages can be copied creating a combined message with the new messages 
insert sd at the correct places in the combined message. 

Appli cants' Sound Annotation System, on the other hand, inserts the markers of sound or 
glyph s in the original message. These markers of sound or glyphs point to a separate 
mess* ge, a soutid annotation. When the marker of sound or glyph is reached during 
playb ack, the system is paused, giving the listener the option of selecting to listen to the 
sounc annotation or not 

The operation and usage of the message insertion in Applicants 4 Sound Annotation 
Syste n is quite different from Daberko's. In Daberko, the message and any inserted 
mess* ges are seamlessly heard without awareness by the user that one or more new 
mess ges have been inserted. In Applicants' Sound Annotation System, the system is 
delilx irately paused when the inserted marker of sound or glyph is reached during 
playback to allow the user the opportunity to select whether they want to listen to the 
assoc ated annotation of sound or not 
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The usage of message Insertion is very different in Applicants' Sound Annotation 
System. The scope of Daberko is quite limited as compared to the system scope and 
flexibi tity provided by Applicants' Sound Annotation System. Daberko has no concept 
of max ters of sound or glyphs which identify the presence of an annotation of sound. In 
Applicants* Sound Annotation System, when a marker of sound or glyph is reached 
during playback, the user can select whether to listen to the annotation of sound- For 
other i dvantages associated with markers of sound and the associated annotations of 
sound refer to the section "Applicants' Sound Annotation System" above. 

Mattb ews 

Matfb :ws provides a method for inserting a marker in audio data. The system copies the 
iata, translating it to a digital format from the recorded analog format A listener 
the system at an appropriate spot while listening to the analog recording. At 
by pressing a predefined key, the user can cause a marker to be added to the 
digital copy. This marker can be a topic marker, a section marker, or a time and date 

When the recording is played back, after being translated back to the analog fonn, 
can be heard. 
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Matth sws's use of markers is quite limited. The markers only identify, for the listener, 
where the topic, section, or time and date stamp markers have been placed. For 
e, there is no capability for the users to identify what they want the sound content 
markers to be and there is no added meaning to the markers themselves. There is 
concept of using the markers to offer a selection to optionally listen to other 
infom lation concerning the recorded audio data. 



The n larker of sound or glyph that is inserted by Applicants' Sound Annotation System is 
much broader in concept as compared to Matthews. In Applicants' Sound Annotation 
System, the marker of sound or glyph can be any sound which in itself can have 
signif cant meaning. The marker of sound or glyph can provide novel and relevant 
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information to a user simply by listening to the marker of sound or glyph. Note that the 
marke r of sound or glyph can consist of any sound, for example, music, beeps, tones, 
human voice, etc. Users of Applicants* Sound Annotation System can define the markers 
of sou nd or glyphs to have special meaning for them. For example, 1) the markers of 
sound or glyphs can provide information about topics, subjects, departments, projects, 
dates, etc., 2) the markers of sound or glyphs can be a single beep denoting a sound 
annotation at the highest level in the hierarchy of sound annotations, and two beeps at the 
second level of the hierarchy, etc., 3) the markers of sound or glyphs themselves can be a 
very t rief summary of the sound annotation to which it points, etc. Any of the above 
usage of markers of sound or glyphs adds significant value and efficiency as the basis for 
users selecting to listen to the annotation or not 

Bala sub ram an ian et al (Bala) 

Bala J provides a method for segmenting audio data by the speakers who have been 
recorc ed. Using algorithms, each speaker is identified and the audio data can be 
identi Bed for each speaker. Indexes are created to identify segments for each of the 

«J 

Applicants' Sound Annotation System is quite different from Bala's. Although Bala 
identi ties speakers, Bala does not add or provide for the addition of any information 
concerning the audio data. Its scope is limited to identifying each speaker and providing 
index ss for the audio recording for each of the speakers. In Applicants' Sound 
Anno ation System, sound annotations may be created by the users of the system. Sound 
annot itions can provide additional valuable, interesting, relevant, and appropriate 
infon nation about the streams of sound For example, 1) the additional information can 
be fiu ther details about the contents of the stream of sound, 2) the additional information 
can b 3 a request for additional details about the stream of sound, 3) the additional 
infbn nation can be agreement or disagreement with the relevant content of the stream of 
sounc , etc. 
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Bala provides indexes for unidirectional communication. No new information is added 
by ussrs. With Applicants 5 Sound Annotation System, the markers of sound or glyphs 
and s ?und annotations can be created by the group or individual creating the sound 
information or by the listeners of the sound information. Applicants' Sound Annotation 
System therefore supports bidirectional as well as unidirectional communication and 
colla1)oration whereas Bala is limited to unidirectional communication. 

Bala s limited to identifying segments associated with a speaker. Applicants* Sound 
Anne tation System provides markers of sound or glyphs which are associated with 
annotations of sound* Bala lacks this feature. For a discussion of the advantages offered 
by availability of markers of sound or glyphs and the associated annotations of sound, 
refer to the section "Applicants' Sound Annotation System' 5 above. The scope and 
flexil ility of Bala is quite limited as compared to Applicants' Sound Annotation System. 

Applicants' New Claims Are Patentable Over The 
References Individually 

Althc ugh the applicants recognize that these claims were rejected on a combination of 
three references, it is first worth noting that their new claims are patentable over Daberko, 
Matthews, and Bala individually for the following reasons: 

1 . Ap plicants* independent claims recite novel subject matter over Daberko because they 
recite that markers of sound or glyphs inserted in a recorded stream of sound, and 
annoi ations of sound that are linked to the markers of sound or glyphs. Daberko provides 
only he insertion of a new message within a recorded message and does not insert any 
mark ?r of sound or glyph into a recorded message, any sound annotation or any user- 
opera ble link between the marker of sound or glyph and the sound annotation. Refer to 
the s< ction "Daberko" above. The novel features of Applicants' Sound Annotation 
System allows one to pause Applicants' Sound Annotation System when a marker of 
sound or glyph is reached during playback so that the user can select whether to listen to 
the a socjated annotation of sound. For a more detailed discussion of these and other 
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cants' Sound Annotation System" above. 



2* Applicants' independent claims recite novel subject matter over Matthews because 
Matth 5ws only inserts markers into audio data but does not provide any capability 
regarc ing the markers other than allowing the user to listen to them during playback- 
Refer to the above section "Matthews" above. Applicants' Sound Annotation System 
create i a marker of sound or glyph inserted into recorded streams of sound and a link 
with a q annotation of sound. The novel features of Applicants' Sound Annotation 
Systei n aliow users to select whether they choose to listen to the associated annotation of 
sound . For a more detailed discussion of these and other capabilities offered by 
Appli sants' Sound Annotation System refer to the section "Applicants' Sound 
Annoi ation System" above. 

3. Ap >licants' independent claims recite novel subject matter over Bala because Bala 
only i ientifies and indexes segments from audio data by speaker but does not insert any 
mark* r of sound or glyph into a recorded message, any sound annotations, or any user- 
opera >lc link between the marker of sound or glyph and the sound annotation. Refer to 
the section "Bala" above. The novel features of Applicants' Sound Annotation System 
allow users to select whether they choose to listen to the associated annotation of sound. 
For a more detailed discussion of these and other capabilities offered by Applicants' 
Sound Annotation System refer to the section "Applicants' Sound System" above. 

4. Thi s novel subject matter in Applicants' Sound Annotation System produces new and 
unexj tected results and is therefore unobvious over each of the references. The 
unexpected results are: 

Pause-ability and Opportunity to Hear Annotation. When a marker of sound 
or glyph is reached during playback of a stream of sound, the system can pause 
the playback and allow the user the opportunity to select whether the associated 
annotation of sound is interesting, relevant, or appropriate for the user. 
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Sound Annotation Nesting. Because annotations of sound are also streams of 
sound, further annotations of sound can also be added to them thereby creating 
sound annotation nesting or a hierarchy of streams of sound and annotations of 
sound and further reducing the sound information that is interesting, relevant or 
appropriate for a user to listen to. 

Navigational Capabilities. Because the system provides the capability of 
identifying markers of sound or glyphs, the system can skip to the next marker of 
sound or sound glyph without listening to the intervening stream of sound or can 
skip to the end of an annotation of sound, thereby providing flexibility and 
efficiency. 

System Tailoring. Because of the flexibility of the basic constructs, the system is 
able to provide for system administrators or users, if appropriate, to tailor the 
system through user-defined operational parameters thereby tailoring the system 
to meet user needs and requirements* 

Unidirectional and Bidirectional Communication and Collaboration. 

Because of the flexibility of the basic constructs, the system is able to provide for 
both unidirectional and bidirectional communication and collaboration. 
Security Protection, and Distribution and Access. Because of the flexibility of 
the basic constructs, the system is able to provide for inclusion of security for 
inclusion of both classified and unclassified information, and the authorized 
distribution of or access to the streams of sound along with the appropriate 
annotations of sound to authorized users. 

Applicants' New Claims Are Patentable Over The 
References As Proposed To Be Combined 

Appl cants submit that all of their new claims are patentable over the proposed 
combination of the above three references because: 

is no legal justification for combining the references 
references can't be physically and opeiatively combined 



There : 
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3. Ev 3ii if the references could be legally and physically combined, applicants' claims 
would still recite novel subject matter over the combination, and 

4. Applicants' novel subject matter produces new and unexpected results and is therefore 
unob' rious. 

1. T iere is no legal justification for combining the references. 
Thero is no reason in Daberko, Matthews, and Bala to suggest their 
com lination, i.e., there is no prima facie case of obviousness to support 
the i reposed combination. 

Appli cants submit that the rejection on Daberko, Matthews, and Bala is improper since 
the re jection does not state any prima facie case of obviousness to support the proposed 
combination, and there is none in fact As stated in MPEP §§ 2142 and 2143, for a 
rejection on a combination of references to be valid, the rejection must provide a prima 
facie case of obviousness. The MPEP states that a prima facie case of obviousness 
requLes three elements: 

a. Th<? References Themselves Must Suggest or Motivate the Combination 

b. An Expectation of Success Must Exist 

c. This References Must Teach or Suggest All of the Claim Limitations. 

a. Tie References Themselves Must Suggest or Motivate the Combination 

As stilted, there must be some suggestion or motivation in the references themselves or in 
knowledge generally available to combine their teachings. T he present rejection does not 
state ; my such teaching or knowledge and the references themselves contain none. 

The 1 taberko, Matthews, and Bala Combination Is Not Justified 

Dabe ko only provides a method for inserting a new message within a previously 
recorded voice message. Mathews only inserts markers for identification of sections or 
topic: during recording audio data. Bala only identifies segments by individual speaker. 
Each of these systems is complete and operative by itself and contains no suggestion or 
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reasoA to selectively take parts of any reference and combine it with part of others to 
come up with applicants' novel system. 

Dabeiko, Matthews, and Bala are complete within themselves. Daberko, Matthews, and 
Bala i ire solving different problems and there is no suggestion that combining them 
wouk strengthen any of them. Combining Daberko, Matthews, and Bala is not logical 
conce rtually or in an implementation. 
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hjecause the three references identify inserting a message within a message, inserting 
into audio data, and identifying indexes to segments of individual speakers, the 

do not justify or teach selectively combining them as proposed. Combining 
references is not taught by the references themselves, any other reference, and is 
conceptually. 



three 



logical < 



Since 



there is absolutely nothing in these references, or in the art generally, to suggest 
that tlkey be combined, applicants submit that one skilled in the art, even if they had the 
references before them, which are individually independent and complete, would 
1 10 reason to combine them. 
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It is elementary in patent law that, in order for two or more references to be combined to 
meet k claim, there must be some teaching or reason stated in or implied from the 
refere nces themselves to suggest the combination. Here the prior-art references do not 
conta n any suggestion that they be combined, or that they be combined in the manner 



needl 



for the prior-art references themselves to suggest that they can be combined is 
l^nown. Kg., as was stated in In re Senator, 2 J 7 U.S .P.Q. 1 , 6 (CAFC 1983): 
art references in combination do not make an invention obvious unless 
sonkething in the prior art references would suggest the advantage to be derived from 
coc ibining their teachings." 
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Thai the suggestion to combine the references should not come from applicants was 
forcei ully stated in Orthopedic Equipment Co. v. United States, 217 U.S.P.Q. 193, 199 
(CAFC 1983): 

1 vrong to use the patent in suit [here the patent application] as a guide through the 
of prior art references, combining the light references in the right way to achieve 
repilt of the claims in suit [here the claims at issue]. Monday morning quarterbacking 
improper when resolving the question of non-obviousness in a court of law [here 
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Jhere i 



stated in Uniroyah Inc. v. Rudldn-Wiley Corp., 5 U.S.P.Q.2d 1434 (CAFC 1988), 
prior-art references require selective combination by the court to render obvious 
subsequent invention, there must be some reason for the combination other than the 
ght gleaned from the invention itself . . . Something in the prior art must suggest the 
desirability and thus the obviousness of making the combination.'* 



Agaiii, the law is clear: where there is no teaching (express or by implication) in the 
refere nces themselves to suggest their combination, the Examiner may not reconstruct 
the p rior art to meet applicants 9 combination by selecting the needed elements from 
each reference to meet the claimed combination. 

It is a ctually the DUTY of the Examiner to explain why the combination of the teachings 
is proper, without using applicants 9 own disclosure. MPEP 2142; is* parte Skinner, 2 
USP< \2d 1788 (Bd. Pat. App. & Inter. 1986). Here the OA clearly has not fulfilled this 
duty. 

The enly relevant statements in the Office Action (OA) are those such as found on p. 3 
when 5 the OA states, "Therefore it would have been obvious ... [to combine Dabenko 
with : Matthews], However this statement is a non-sequitur because the preceding 
paragraphs of the OA foil to provide any such prima facie case or knowledge. The OA 
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merely states (p. 3) that Dabenko and Matthews show parts of applicants' combination, 
but this fact above does not justify the combination. The references themselves or the art 
gener ally must contain some'actual teaching or suggestion to make the combination. 
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Also, the fact that the combination provides advantages does not justify the combination, 
but ac tually militates against it and in applicants' favor. I.e., the fact that a new 
combination provides an advantage does not prove that it would be obvious to make that 
combination- but rather it proves just the opposite: Where old references which 
them; elves do not suggest their combination are combined and the combination yields 
subst intial advantages, that proves that the combination has new and unexpected results 
and h therefore unobvious. In other words, the above paragraphs from the OA 
actus lly support applicants' contention that his system is not obvious. 

Agaii l, note that the OA does not refer to any place in Daberko, Matthews, or Bala that 
indicates that it would be obvious to combine these references, but actually admits that 
the ui [suggested combination has substantial advantages. 

It is h ombook patent law that when a combination provides new, valuable, and 
unexjjected results like this, it indicates that the combination is indeed unobvious. Thus 
the si gnificant and important advantages of applicants' novel combination that the OA 
lists < learly show that the combination of Daberko and Mathews is in feet unobvious. 

b. An Expectation of Success Must Exist 

Then; must be a reasonable expectation of success from making the combination- Here 
there is none since the three systems are so different that they could not be combined or 
subst ituted. I.e., Dabcrko's system is designed to work only as an apparatus for inserting 
new messages within other messages, Matthews's system is designed as an apparatus to 
only nsert markers that can only be heard during playback, and Bala's system is 
desigied as an apparatus to only identify indexes to segments of individual speakers. If 
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an auc io engineer had these references before her, she would not be at all led to combine 
them £ bsent applicants 1 teachings- 

c. Thi > References Must Teach or Suggest All of the Claim Limitations. 

Here none of the references teaches all of the above claim limitations. Specifically neither 
Dabci k ko 9 Matthews, nor Bala teaches any audio annotating system, as claimed. 
Applicants' claims recite that markers of sound or glyphs are inserted into streams of 
sound at the relevant position with the streams of sound and the markers of sound or 
glyph: ; link with appropriate annotations of sound. Daberko simply inserts new 
messa ges within other messages, Matthews simply inserts markers during the 
trans ation of the analog information to digital information, and Bala simply 
identifies indexes to segments of individual speakers. Thus none of the references 
teach or show what the applicants' claims recite- The novel features of applicants' 
claim: ; over the combination are listed in more detail below. 

Since the OA does not provide the three elements (points a-c above) required for a prima 
facie i :ase of obviousness to support the proposed combination, applicants submit that 
there s clearly no prima facie case of obviousness or justification for combining these 
dispai ate references. Again, the law clearly and explicitly requires that the Examiner 
provi( le a prima facie case of obviousness for combining references. 



he references themselves actually teach away from the suggested combination, 



Here 

since each is complete in and of itself and is so different from the other. Applicants thus 
subtn t that one having ordinary skill in the art, even if the references were before them, 
woul< i be led not to combine them because of their individual completeness. 

If the rejection is based on these references, applicants respectfully request that the 
Exait iner state some reasons that support a prima facie case of obviousness, as required 
by M *EP §§ 2142 and 2143. I.e., where in the references themselves or in the art 
genei ally (without using applicants' disclosure) do they suggest that they be combined? 
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Applfciants respectfully submit that, absent such a prima facie showing as required by the 
MPEI ; any rejection on Daberko, Matthews, and Bala must fail. 

2. Daberko, Matthews, and Bala can't be physically and 
opeiatively combined. 

Even f one wanted to combine these references, it would not be technically feasible to do 
so bee ause Daberko, Matthews, and Bala solve different problems, take different 
appro iches, and have very different user interfaces. Refer to the discussion in the section 
'The Daberko, Matthews, and Bala Combination Is Not Justified" above. 

3. Even if Daberko, Matthews, and Bala could be legally and 
physically combined, the independent claims would still recite 
novul subject matter over the combination. 

Even if it were legally permissible to combine the references, applicants- claims would 
still he novel and provide unexpected results over the combination of the references. The 
first i idependent claim, claim 32, recites novel subject matter over the combination of 
Daberko, Matthews, and Bala 

Applicants 1 claim 32 recites "inserting a predetermined sound marker into said 
recorded stream of sound, said predetermined sound marker being distinguishable 
from the sound in said recorded stream". 

Daberko inserts a message within another message. When the resulting message 
is played back, the user is not aware that the resulting message contains an 
included message. Refer to the section "Daberko" above. Applicants' Sound 
Annotation System inserts a marker of sound or glyph into a recorded stream of 
sound but the objective for the marker of sound or glyph is quite different from 
Daberko, When the marker of sound is reached during playback, Applicants* 
Sound Annotation System is paused allowing the user to determine whether to 
listen to the annotation of sound that is linked to the marker of sound or glyph. 
Refer to the section "Applicants* Sound Annotation System" above. 
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Matthews provides for the insertion of markers in the audio file while it is being 
translated to a digital format When the audio file is played back, a user is limited 
to only listening to the playback. Refer to the section "Matthews" above. With 
Applicants' Sound Annotation System a marker of sound is inserted into the 
recorded stream of sound at a relevant point with the content of the recorded 
stream of sound. The marker of sound or glyph is linked with an annotation of 
sound. During playback and when the marker of sound or glyph is reached, 
Applicants' Sound Annotation System is paused allowing the user the opportunity 
to choose whether to listen to the annotation of sound. Refer to the section 
"Applicants' Sound Annotation System" above. 

Bala makes no mention of inserting a message or a marker within a message or 
audio file. Refer to the section "Bala" above. 
Applicants' claim 32 recites "providing a recorded sound annotation". 
Daberko, Matthews, and Bala make no mention of a recorded sound annotation. 
Refer to the sections "Daberko", "Matthews", and "Bala" above. 
Applicants' claim 32 recites "providing a user-operable link between said 
predetermined sound marker and said recorded sound annotation so that when 
said predetermined sound marker is reached during playback of said recorded 
stream of sound, a user can elect to hear said recorded sound annotation". 
Daberko and Bala make no mention of a marker or sound or glyph or a sound 
annotation and therefore no concept of choosing whether to listen to optional 
recordings. Refer to the sections "Daberko" and "Bala" above. 
Matthews provides for the insertion of markers into the digital audio recording 
during translation. This marker can be heard during playback. However, 
Matthews' marker can only be heard. There is no concept of annotations of sound 
or pausing the system to give the user a choice whether to listen to additional 
audio recordings. Refer to the section "Matthews" above. 

s econd independent claim, claim 39, recites novel subject matter over the 
combination of Daberko, Matthews, and Bala. 
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Applicants* claim 39 recites "...said computer system comprising: 1) a recorded 
stream of sound, 2) at least one recorded marker of sound, comprising a 
predetermined sound inserted into said recorded stream of sound, said 
predetermined sound being distinguishable from other sound in said recorded 
stream of sound, 3) a separately created and recorded sound annotation, said 
marker of sound providing a user-operable connection or link to said sound 
annotation so that when said marker of sound is reached during playback of said 
stream of sound, a user can elect to hear said recorded sound annotation". 
Daberko inserts a message within another message. During playback the resulting 
message can be heard by the user without knowing that a message was previously 
inserted. Daberko has no concept of sound annotations, markers of sound or 
glyphs, and user selection whether to listen to additional messages. Refer to the 
section "Dabeiko" above* 

While translating an analog audio file to a digital audio file, Matthews enables 
users to insert markers. During playback these markers can be heard by the 
listener. Matthews has no concept of sound annotations or pausing the system to 
optionally allow the user to listen to another recorded audio file. Refer to the 
section 4e Matthews" above. 

Bala has no concept of markers of sound or glyphs and of sound annotations. 
Refer to the section "Bala" above. 

The tl ird independent claim, claim 47, recites novel subject matter over the combination 
of Daperko, Matthews, and Bala. 

Applicants' claim 47 recites ".. .comprising: a* means for recording a stream of 
sound, b- means for inserting at least one marker or glyph into said stream of 
sound, said marker or glyph having a predetermined frequency, c means of 
recording at least one sound annotation, d. means for associating said annotation 
of sound with said marker or glyph so that when said stream of sound is played 
and said marker or glyph is reached, said sound annotation can be selectively 
played". 
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Daberko inserts a message into another message. When the resulting message is 
played back the listener can hear the resulting message without knowledge that a 
message had been inserted within it. Daberko has no concept of markers of sound 
or glyphs, sound annotations, or pausing the system allowing a user the 
opportunity to select whether to listen to additional messages. Refer to the section 
"Daberko" above. 

During the translation of an analog audio file to a digital audio file Matthews 
provides for users to insert markers. During playback these markers can only be 
heard by the user. Matthews has no concept of sound annotations or pausing the 
system to allow the user the opportunity to choose to listen to additional audio 
files. Refer to the section "Matthews'* above. 

Bala has no concept of markers of sound or glyphs, sound annotations. Refer to 
the section "Bala" above. 

The fourth independent claim, claim 53, recites novel subject matter over the 

comb nation of Daberko, Matthews, and Bala. 

• Applicants 5 claim 53 recites ". . .comprising: a. means for recording a stream of 
sound, b. means for inserting at least one marker or glyph into said stream of 
sound, said marker or glyph having a predetermined frequency, c. means of 
recording at least one sound annotation, d. means for associating said annotation 
of sound with said marker or glyph so that when said stream of sound is played 
and said marker or glyph is reached, said sound annotation can be selectively 
played". 

Daberko inserts a message within another message. During playback the resulting 
message is heard by the user without knowledge that a message had been inserted. 
Daberko has no concept of markers of sound or glyphs, sound annotations, and 
pausing the system to allow the user to select whether to listen to additional 
messages. Refer to the section "Daberko" above. 

Matthews provides for the insertion of markers during the translation of an analog 
audio file into a digital audio file. During playback the markers can be heard by 
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the listeners. Matthews has no concept of sound annotations or of pausing the 
playback to allow the user to choose to listen to additional audio files. Refer to 
the section "Matthews" above. 

Bala has no concept of markers of sound or glyphs or sound annotations. Refer to 
the section "Bala" above. 

4. Tlje Novel Subject Matter of the Independent Claims Produces 
New and Unexpected Results and is Therefore Unobvious. 

The novel features of the independent claims produce new and unexpected results. The 
previc usly identified unexpected results which are unobvious are repeated here for the 
convefiience of the Examiner: 

Pause-ability and Opportunity to Hear Annotation. When a marker of sound 
or glyph is reached during playback of a stream of sound, the system can pause 
the playback and allow the user the opportunity to select whether the associated 
annotation of sound is interesting, relevant, or appropriate for the user. 
Sound Annotation Nesting. Because annotations of sound are also streams of 
sound, further annotations of sound can also be added to them thereby creating 
sound annotation nesting or a hierarchy of streams of sound and annotations of 
sound and further reducing the sound information that is interesting, relevant, or 
appropriate for a user to listen to. 

Navigational Capabilities. Because the system provides the capability of 
identifying markers of sound or glyphs, the system can skip to the next marker of 
sound or sound glyph without listening to the intervening stream of sound or can 
skip to the end of an annotation of sound, thereby providing flexibility and 
efficiency. 

System Tailoring* Because of the flexibility of the basic constructs, the system is 
able to provide for system administrators or users, if appropriate, to tailor the 
system through user-defined operational parameters thereby tailoring the system 
to meet user needs and requirements. 
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Unidirectional and Bidirectional Communication and Collaboration. 

Because of the flexibility of the basic constructs, the system is able to provide for 
both unidirectional and bidirectional communication and collaboration. 
Security Protection, and Distribution and Access. Because of the flexibility of 
the basic constructs, the system is able to provide for inclusion of security for 
inclusion of both classified and unclassified information, and tbe authorized 
distribution of or access to the streams of sound along with the appropriate 
annotations of sound to authorized users* 

There bre applicants submit that the independent claims recite novel and unobvious 
subjec t matter over die proposed combination of the references. Applicants therefore 
submi t that the independent claims should be allowed. 

The d jpendent claims incorporate all of the subject matter of the independent claims and 
add additional subject matter and therefore are a fortiori patentable over Daberko and 
Matt! icws, and Bala. 

There fore applicants submit that allowance of claims 32 to 59 is warranted and they 
respectfully request same. 

Thel Rejection Of Claims 6, 14, 22, And 28 On Daberko, 
Matthews, Bala, And Nakamura et al (Nakamura) Is 
Overcome 

These dependent claims incorporate all of the limitations of the independent claims 
discussed above and add additional limitations. Therefore these claims are a fortiori 
paten able. For a review of Daberko, Matthews, and Bala refer to the sections 
"Dabsrko", "Matthews", and "Bala" above. 

Nakamura 
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Nakamura shows a document editing system for adding and managing speech or audio 
infom ation to text information- While Nakamura adds speech or audio information to 
text, Applicants' Sound Annotation System adds sound information to a recorded stream 
of sou id. Applicants' Sound Annotation System inserts markers of sound or glyphs to a 
record ed stream of sound at a relevant point in the stream of sound The markers of 
sound link with annotations of sound. During playback when a marker of sound or glyph 
is rear bed, the system is paused and the user chooses whether to listen to the associated 
annotj ition of sound. 

The E icaminer cited Nakamura to show use of a password to gain access to the editing 
systen i. Obviously, Nakamura is not the only system or implementation to include some 
form < >f security. Security is recited in some of Applicants' dependent claims to claim the 
embodiment of Applicants* Sound Annotation System that uses security. 

Applicants' New Claims Are Patentable Over Nakamura 
Individually 

Altho ugh the applicants recognize that these claims were rejected on a combination of 

srences, it is first worth noting that their new claims are patentable over 
Nakaijnura individually for the following reasons. 



Appli Mints' independent claims recite novel subject matter over Nakamura because the 
claim 5 recite that markers of sound or glyphs are inserted in a recorded stream of sound, 
and a] inotations of sound are linked to the markers of sound or glyphs. When a marker of 
sounc or glyph is reached during playback, the Applicants' Sound Annotation System is 
pause d to allow the user the opportunity to select whether to listen to the associated 
annot ations of sound. Nakamura, on the other hand, shows only adding and managing 
speec i or audio information to text information. For a more detailed discussion of these 
and oiher capabilities offered by Applicants* Sound Annotation System refer to the 
sectic n "Applicants* Sound Annotation System' 5 above. 
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unex] 
and m 
These 



subject matter in Applicants' Sound Annotation System produces new and 
picted results and is therefore unobvious over Nakamura. A discussion of the new 
expected results when compared to Daberko, Matthews, and Bala are above, 
new and unexpected results are also applicable to Nakiamura. 



three 
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' New Claims Are Patentable Over The 
As Proposed To Be Combined 



Applicants 
References 

Applicants submit that all of their new claims are patentable over the proposed 
combi nation of the above four references for the reasons discussed above and because it 
would! not be obvious to combine Nakamuia with the other tJiree references. 

1. There is no legal justification for combining the references. 
Thenfe is no reason in Nakamura to suggest its combination with the other 
three references, i.e., there is no prima facie case of obviousness to 
support the proposed combination. 

The a x)ve section which discusses the lack of justification for the combination of 
Dabeilko, Matthews, and Bala also applies to the combination of Nakamura with these 



■eferences. 



a. The References Themselves Must Suggest or Motivate the Combination 

As sto ted, there must be some suggestion or motivation in the references themselves or in 
know edge generally available to combine their teachings. The present rejection does not 
state i my such teaching or knowledge and the references themselves contain none. 



suggc stion 



Dabe'kO; 



Nakafnura shows a system which is complete and fully operative of itself and there is no 
t or teaching in Nakamura that this system could be used with systems such as 
), Matthews, and Bala. 
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the four references identify inserting a message within a message, inserting a 
into audio data, identify indexes to segments of individual speakers, and add and 
speech and audio information to text, do not justify or teach combining them. 
Combining the four references is not logical conceptually or in an implementation. 



Furthe - legal discussion referring to the combination of references is above. 



b. An 



information, 



engineer 
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Expectation of Success Must Exist 

Nakan^ura is an editing system to add and manage speech and audio information to text 
If Nakamura is added to Dabeiko, Matthews, and Bala and if an audio 
■ had these references before her, she would not be at all led to combine them, 
absent! applicants 7 teachings. 



c. Thii References Must Teach or Suggest All of the Claim Limitations. 

Even if Nakamura were combined with the other three references, the claims would still 
recite novel structure over the combination. Above specific citations have been quoted 
from t lie four independent claims- Against these same citations, Nakamura can be added 
to the same discussion. Refer to the above discussion. Nakamura simply adds and 
manaf ;es speech and audio information with text information. Nakamura makes no 
menti( >n of markers of sound or glyphs, annotations of sound, and therefore no linking of 
annofc itions of sound with markers of sound or glyphs or pausing the system to allow 
users he opportunity to select whether they want to listen to additional sound 
information. 

Addit ional legal implications concerning the proposed combination are included above. 



2, 

and 

Previous 



opera lively 



Dkberko, Matthews, Bala, and Nakamura can't be physically 
operative ly be combined. 

discussion describes why Dabeiko, Matthews, and Bala can't be physically and 
combined. Even if one wanted to combine Nakamura with the other three 
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it would not be possible to do so physically or operatively because the 
of Nakamura does not make the combination physically and operatively 
e. Nakamura shows a document editing system for adding and managing speech 
o information to text information- Nakamura solves a different problem, takes a 
diflfere it approach, and has a different user interface. 



3. The Novel Subject Matter of these Independent Claims 
Produces New and Unexpected Results and is Therefore 
Unobvious. 

As ide citified above, Nakamura has no concept of the basic constructs of Applicants* 
Sound Annotation System; therefore all of the new and unexpected results identified 
above are also applicable to Nakamura, 

There] ore applicants submit that the independent claims recite novel and unobvious 
subject matter over the proposed combination of the references* Applicants therefore 
submi t that the independent claims should be allowed. 

The d jpendent claims incorporate all of the subject matter of the independent claims and 
add at ditional subject matter and therefore are a fortiori patentable over Daberko and 
Mattlicws, and Bala, and Nakamura, 

There :bre applicants submit that allowance of claims 32 to 59 is warranted and they 
respe< tfiilly request same. 



The 



Thes* 



discuised 



Rejection Of Claims 16-17 And 30-31 On Daberko, 
itjthews, Bala, And Logan et al (Logan) Is Overcome 

dependent claims incorporate all of the limitations of the independent claims 
I above and add additional limitations. Therefore these claims are a fortiori 
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e. For a review of Daberko, Matthews, and Bala refer to the sections 



patentable 

"Dabeiko", tc Matthews'\ and "Bala* above. 



Logan 

Logan' 
record ngs. 



thecri 
Applicjants 
utilize 



s system collects, distributes, and exchanges information in the form of audio 
A user can identify their interests and preferences, and recordings matching 
can be distributed to the user. Users can also comment on the recordings. 
' Sound Annotation System is different from Logan's because Logan does not 
markers of sound or glyphs or the linking of them to sound annotations. 



cn ena 



The 
preferi 
their 



Examiner ( 



cited Logan due to its reference to personal information and programming 
|nces, and playback parameters. However, Logan merely enables users to identify 
Terences; Applicants' Sound Annotation System provides a muck more extensive 
tailoring capability. For example, Applicants 1 Sound Annotation System allows tailoring 
for individual needs or requirements but also allows for system-wide tailoring to meet the 
company, an installation, a group, etc. Obviously Logan is not the only system 
to include some form of user preference, or system or user tailoring, 
predefined logic or conditions and user-defined operational parameters are recited in 
i iependent claims but it would not be obvious to combine Logan with the other 
refere ices, but even if combined, the claims would still define novel and patentable 
subje< t matter. 

Applicants 1 New Claims Are Patentable Over Logan 
Individually 

: recognize that these claims were rejected on a combination of four 
s, it is first worth noting that their new claims are patentable over Logan 
individually for the following reasons: 



needs of a 
or imi letnentation 
The 
these 



Although applicants ] 



references. 



Applicants' independent claims recite novel subject matter over Logan because they 
recite that markers of sound or glyphs inserted in a recorded stream of sound, and 
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annotalions of sound that are linked to the markers of sound or glyphs. Logan has no 
concept of markers of sound or glyphs and annotations of sound, and therefore no 
concept of linking between the two, but rather has only a system which collects, 
distributes, and exchanges information in the form of audio recordings. When a marker 
of sour id or glyph is reached during playback, these features of the Applicants' Sound 
Annoti ition System allow the system to pause and allow the user to select whether to 
listen to die associated annotations of sound. For a more detailed discussion of these and 
other capabilities offered by Applicants' Sound Annotation System refer to the section 
"Applicants' Sound Annotation System" above. 

This n )vel subject matter in Applicants' Sound Annotation System produces new and 
unexpected results and is therefore unobvious over Logan for reasons discussed above 
with re gards to the other references. 

Applicants' New Claims Are Patentable Over The 
Refc rences As Proposed To Be Combined 

Applicants submit that all of their new claims are patentable over the proposed 
combi nation of the above four references for reasons discussed above and because it 
would not be obvious to combine Logan with the other three references. 

1. There is no legal justification for combining the references. 
Then s is no reason in Logan to suggest its combination with the other three 
references, i.e., there is no prima facie case of obviousness to support the 
proposed combination. 

The a x>ve section which discusses the lack of justification for the combination of 
Dabako, Matthews, and Bala also applies to the combination of Logan with the other 
three references. 

a. The References Themselves Must Suggest or Motivate the Combination 
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As stat id, there must be some suggestion or motivation in the references themselves or in 
knowk dge generally available to combine their teachings. Hie present rejection does not 
state any such teaching or knowledge and the references themselves contain none. 



Logan 



shows a system which is complete and fully operative of itself and there is no 
sugges lion or teaching in Logan that this system could be used with systems such as 
Daberko, Matthews, and Bala. 



Even 
recite 
from 



sounc 



Just because the four references identify inserting a message within a message, inserting a 
marker into audio data, identify indexes to segments of individual speakers, and add and 
manage speech and audio information to text, do not justify or teacb combining them. 
Combi ning the four references is not logical conceptually or in an implementation. 

Further legal discussion referring to the combination of references is above. 

b. An Expectation of Success Must Exist 

Logan provides for a system to collect, distribute, and exchange information in the form 
of audio recordings. If Logan is added to Dabexko, Matthews, and Bala and if an audio 
engutu er had these references before her, she would not be at all led to combine them, 
absen applicants' teachings. 

c. Thfe References Must Teach or Suggest All of the Claim Limitations. 

f Logan were combined with the other three references, the claims would still 
novel structure over the combination. Above specific citations have been quoted 
he four independent claims. Against these same citations, Logan can be added to 
the same discussion. Refer to the above discussion. Logan simply collects, distributes, 
and e cchanges information in the form of audio recordings. Logan makes no mention of 
markers of sound or glyphs, annotations of sound, and therefore no linking of annotations 
with markers of sound or glyphs or pausing the system to allow users the 



oppoi tunity to select whether they want to listen to additional sound information. 
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Additfc nal legal implications concerning the proposed combination are included above, 

2. Daberko, Matthews, Bala, and Logan can't be physically and 
operatively be combined. 

Previous discussion describes why Daberko, Matthews, and Bala can't be physically and 
operati vely combined. Even if one wanted to combine Logan with the other three 
referee ces, it would not be possible to do so physically or operatively because the 
addition of Logan does not make the combination physically and operatively possible. 
Logan shows a system that collects, distributes, and exchanges information in the form of 
audio iccordings. Logan solves a different problem, takes a different approach, and lias a 
differe nt user interface. 



3. 
New 

As 



The 



Novel Subject Matter of the Independent Claims Produces 
and Unexpected Results and is Therefore Unobvious. 

identified above, Logan bas no concept of the basic constructs of Applicants' Sound 
Annot Jiion System; therefore all of the new and unexpected results identified above are 
also applicable to Logan. 

There: ore, applicants submit that the independent claims recite novel and unobvious 
subjec t matter over the proposed combination of tbe references. Applicants therefore 
submi t that the independent claims should be allowed. 

The d jpendent claims incorporate all of the subject matter of the independent claims and 
add a< ditional subject matter and therefore are a fortiori patentable over Daberko and 
Matthews, and Bala, and Logan. 

Therefore applicants submit that allowance of claims 32 to 59 is warranted and they 
respectfully request same. 
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Conclusion 



above Teasons, applicants submit that the claims as amended are patentable over 
cited references, taken either singly or in combination, because (a) there is no 
or prima facie case that the refs should be combined, but (b) even if they were 
combined, the combination would not show the invention as claimed and me novel claim 
are unobvious and patentable. 



For the 
all of the 
teaching 



define, 
claims 
respecjfhlly 
to the 
place 
furthei 



features 



Accordingly applicants submit that allowance of claims 32 to 59 is warranted and 
respect fully request such action. 

Conditional Request For Constructive Assistance 

Applic ants have made a diligent effort to amend the claims of this application so that mey 
novel structure that is also unobvious. If, for any reason the Examiner believes 
of this application are not believed to be in full condition for allowance, applicants 
request the constructive assistance and suggestions of the Examiner pursuant 
pirit of MPEP § 2173.02 and § 707.070. This will enable the undersigned to 
i his application in allowable condition as soon as possible and without tbe need for 
proceedings. Applicants authorize the Examiner to make any minor corrections. 



Very respectfully, 

John W. Brittain Thomas J. Eccles 

Applicants Pro Se 



C/oJphnW. Brittain 
20380 Wolcot Way 
Sara* >ga,C A 95070 
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Certifu ate of Faxing: I hereby certify that 1 will fax this paper to GAU 2655 of the U.S. 
Patent And Trademark Office at 571-273-8300 on the date below: 



Date: 2305 August 24 



Joint Applicant 
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